Electronic book data delivery apparatus, electronic book device and recording medium

ABSTRACT

An electronic book device receives from an external delivery source book data representing the contents of a book, a reciter images, for example, of famous persons who read aloud the contents of the book based on the received book data, and the corresponding reciter voice data, and then displays the received book data and reciter images on the display. A user views the received book data and reciter images displayed on the display and causes the reciter images to read the book data aloud in voices represented by the reciter voice data.

FIELD OD THE INVENTION

[0001] The present invention relates to electronic book data deliveryapparatus, electronic book device and recording mediums for reproducingthe content of a book in a voice of a desired famous person or voiceactor or actress.

BACKGROUND ART

[0002] Recently, letters, voices and images are increasinglyelectronized. Mobile terminals have been developed which reproduceso-called multimedia data composed of combined electronized letters,voices and images from second terminals through a network such astelephone lines or the Internet or via communication means. One of suchmobile terminals is an electronic book device that reproduceselectronized book data in a specified voice.

[0003] The electronic book device comprises a storage medium that storeselectronized book data, a liquid crystal display unit, a manual inputunit that selects desired book data and/or turns the page, and acontroller that controls the respective elements of the book device.When desired book data is selected at the input unit, the controllerreads the selected book data from the storage medium, and displays thedata on a first page thereof on the display unit. When an instruction ofpage turning is given at the input unit, the data on a next page isselected and displayed on the display unit.

[0004] Compared to a conventional book made of paper, the electronicbook device restricts consumption of resources and is capable of storingdata of a plurality of book data. Thus, it is convenient to carry aboutand to manage the book. Since the electronic book device has suchvarious advantages, the development of electronic book devices hasrecently advanced rapidly.

[0005] Like the conventional books made of paper, the electronic bookdevice, however, only offer letter and/or image data to a user so as tovisually read the data. Therefore, the book device is poor inexpressiveness. Thus, realization of richer expressiveness provided by acombination of letters, voice, and images is desired.

[0006] Books range from stories/novels made mainly of letters to cartoonor comic made mainly of mixed images and letters. In the case of acartoon or comic, many letters and images are displayed on one page, sothat in the portable electronic book device letters and images displayedon the display screen are difficult to view dearly due to a restrictedsize of the screen.

[0007] As the portable telephones and other terminals have diffused, auser frequently carries an electronic book device of the above type andmany other wearable devices about the user. Therefore, it is desired toimprove the operability of the respective devices to be carried about intie simultaneous usage of the functions of the respective devices andthe convenience of carrying the devices. The electronic book deviceshave several aspects to be improved further.

[0008] It is therefore an object of the present invention to provide anelectronic book data delivery apparatus, an electronic book device and arecording medium that are capable of reading the content of a book aloudin the voices of reciters who include well-known persons, voiceactors/actress, etc.

[0009] Another object of the present invention is to provide anelectronic book data delivery apparatus, an electronic book device and arecording medium that are capable of obtaining anywhere and anytimeimages and voice data of reciters who include the famous persons, voiceactors/actresses, etc., that read the content of a book aloud, andcausing a desired one of those images to be displayed and to recite thecontent of the book aloud in its voice.

[0010] A further object of the present invention is to provide anelectronic book data delivery apparatus, an electronic book device and arecording medium that are capable of reading aloud the contents of abook in a voice comfortable to a user.

[0011] In order to achieve the above objects, in an electronic book datadelivery apparatus according to the present invention, storage means hasstored a plurality of book data each representing the content of anelectronic book, a plurality of reciter images each for reading aloudthe content of a book represented by a respective one of the pluralityof book data, and a plurality of voice data each representing a voice ofa respective one of the plurality of reciter images. Receiving meansreceives a request for delivery of a selected one of the plurality ofbook data and at least one selected one of the plurality of reciterimages for reading the selected book data aloud from an externalelectronic book device via communicating means. Sending means isresponsive to the request for delivery for reading the selected bookdata, the at least one reciter image, and voice data representing thevoice of the at least one reciter image from the storage means and forsending those data via the communication means to the externalelectronic book device.

[0012] In another aspect of the present invention, in an electronic bookdata delivery apparatus first receiving means receives at least onereciter image and corresponding voice data used to read the contents ofan electronic book aloud, via a network from an external terminal.Storage means stores the at least one reciter image and correspondingvoice data in corresponding relationship. Second receiving meansreceives a request for delivery of at least one reciter image via anetwork from an external electronic book device. Sending means isresponsive to the second receiving means receiving the request fordelivery for reading out the at least one reciter image andcorresponding voice data that satisfy the request from the storagemeans, and for sending the read at least one reciter image andcorresponding voice data to the external electronic book device.

[0013] In a further aspect of the present invention, in an electronicbook device connected via a network to an external book data deliverysource having stored a plurality of book titles, a plurality of reciterimages and a plurality of voice data each representing a voice of arespective one of the plurality of reciter images, first receiving meansreceives via the network a plurality of book titles and a plurality ofreciter images each used to read aloud the contents of a book having arespective one of the plurality of book titles. Specifying meansspecifies a desired one from among the plurality of book titles receivedby the first receiving means and at least one desired reciter image fromamong the plurality of reciter images for causing the specified at leastone desired image to read aloud the contents of the book having thespecified title. Second receiving means receives book data having thespecified book title, the specified at least one reciter image, and thecorresponding voice data from the external book data delivery source.Display means displays the book data and the at least one reciter imagereceived by the second receiving means. Means is provided forreproducing the content of the book that is represented by the book datadisplayed by the display means in a voice(s) represented by the voicedata corresponding to the displayed at least one reciter image.

BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The above and other objects and advantages of the invention willbecome more apparent and will be more readily appreciated from thefollowing detailed description of the presently preferred exemplaryembodiments of the invention taken in conjunction with the accompanyingdrawings, in which:

[0015]FIG. 1 schematically illustrates an inventive voice reproducingsystem communicating with an external device;

[0016]FIG. 2 schematically illustrates data communication performedbetween an electronic book device and a wearable device that compose thevoice reproducing system;

[0017]FIG. 3 is a block diagram of the electronic book device, a bookdata delivery center (host server), the wearable device, and a copyrightholder terminal;

[0018]FIG. 4 illustrates the composition of an internal RAM of theelectronic book device;

[0019]FIG. 5 illustrates the composition of a book ROM of the hostserver;

[0020]FIG. 6 illustrates the composition of a RAM of the copyrightholder terminal;

[0021]FIG. 7 is a flowchart of processes performed by the electronicbook device, the book data delivery center (host server), and thecopyright holder terminal;

[0022]FIG. 8 is a flowchart of a book data/reciter image select process;

[0023]FIG. 9 is a flowchart of a book data reading-aloud process;

[0024]FIGS. 10A and 10B illustrate a picture in which a book to be readaloud is to be selected, and a picture in which the book to be readaloud has been selected, respectively;

[0025]FIGS. 11A and 11B illustrate a picture in which reciter imagesthat read a book aloud are to be selected and a picture in whichcharacters appearing in the book and reciter images who are to beselected and allocated to the character images are displayed,respectively;

[0026]FIGS. 12A and 12B illustrate a picture in which reciter images areselected and allocated to the character images, respectively, and apicture appearing during recitation of the book, respectively; and

[0027]FIGS. 13A and 13B illustrate a picture in which reciter images areallocated to narrator images, respectively, who narrate a book, and apicture appearing during recitation of the book, respectively.

DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENT

[0028] An embodiment of an electronic book device and voice reproducingsystem according to the present invention will be described in moredetail below with reference to the accompanying drawings.

[0029] Compositions:

[0030]FIG. 1 schematically illustrates an inventive voice reproducingsystem communicating with an external device; FIG. 2 schematicallyillustrates data communication performed between an electronic bookdevice and a wearable device that compose the voice reproducing system;FIG. 3 is a block diagram of the electronic book device, a book datadelivery center (host server), the wearable device, and a copyrightholder terminal; FIG. 4 illustrates the composition of an internal RAMof the electronic book device; FIG. 5 illustrates the composition of abook ROM of the host server; and FIG. 6 illustrates the composition of aRAM of the copyright holder terminal.

[0031] Referring to FIGS. 1 and 3, the voice reproducing system 100includes a portable electronic book device 1 and a wearable device 20.As shown in FIGS. 1 and 2, the electronic book device 1 comprises a pairof display panels 1A and 1B hinged to each other. The display panels 1Aand 1B each comprise a liquid crystal display unit 4. The book device 1has a built-in electronic circuit of FIG. 3 behind the display panels 1Aand 1B. The display panel 1A comprises a rotary switch 11, a speaker 1E,other switches including a power supply switch (not shown) and a windowthrough which data is transmitted to the wearable device 20. The displaypanel 1B comprises a microphone 1C, and an input device 3 including adial unit 3 d and an auto dial switch 3 d. A battery pack (not shown) isprovided on the rear surface of the display panel 1B.

[0032] As shown in FIGS. 1 and 2, the wearable device 20 is made mainlyof a device proper 20A and earphones 28 with the device proper 20Acontaining an electronic circuit of the device 20 shown in FIG. 3. Amanual input unit 22, a data receive window through which data isreceived from the electronic book device 1, and an earphone jack notshown) into which a standard earphone plug (not shown) is insertable areprovided on the device proper 20A at predetermined positions.

[0033] The wearable device 20 receives voice data (including telephonecall voice data and book reading aloud voice data) wirelessly from theelectronic book device 1, and outputs a voice from the earphones or aheadphone (hereinafter, referred to simply as earphones 28).

[0034] The electronic book device 1 has a book data reading-aloud orreciting function that includes converting the book data into voices inwhich the book data is read aloud, a telephone function that includesperforming telephonic and data communication with an external device,and a timepiece function that displays calendar information.

[0035] In the description below, the “book data” includes letter data,image data, data related to the book, and read-aloud voice reproducingdata. The “data related to the book” includes information other than thecontent of the book, such as a title of the book, the author's name, andthe publishing company's name concerned. The “read-aloud voicereproducing data” includes various data necessary for producingread-aloud voice data in a reading-aloud voice producer 13 of theelectronic book device 1. For example, the read-aloud or reciting voicereproducing data includes data on types of books such as cartoon orcomic books and novels, data on sound effects lasts, sounds of wind) tobe reproduced, and a reciter voice table that has recorded voice typesof famous persons, voice actors/actresses, etc., as reciters.

[0036] In a book mode, the electronic book device 1 displays on thedisplay unit 4 letter and image data contained in the book data selectedby a user at the input unit 3, converts the letter data into voice data(text voice synthesis) and audibly outputs the voice data from thespeaker 1E provided on the device 1 or the earphones 28 provided on thewearable device 20. When the voice data is output from the earphones 28,read-aloud voice data (the details of which will be described later)based on the book data is sent via the transmitter 16 to the wearabledevice 20. The wearable device 20 audibly outputs from the earphone 28the read-aloud voice data received by the receiver 26.

[0037] As shown in FIG. 1, in a telephone mode the electronic bookdevice 1 connects to a mobile-terminal communication network via abasestation 43 for mobile communication terminals such as mobile phones andPHSs (Personal Handyphone Systems) to have telephonic communication withanother mobile communication terminal 44 or communicates with a fixedtelephone via a public network line 40 to download desired book data.The electronic book device 1 is capable of accessing a host server 30 ofa book data delivery site (book data delivery center HS) in the network40 to download desired book data, and sending/receiving electronic mailsto/from an external personal computer (PC).

[0038] The electronic book device 1 is further capable of connecting bycable or wirelessly to a book data delivery terminal 42, for example,installed in a book store or a convenience store to download book datastored in the book data delivery terminal 42 or in a host server 30 viathe book data delivery terminal 42.

[0039] When the electronic book device 1 detects arrival of an incomingcall in the book mode in which book data is being read aloud orreproduced, the book device 1 reports this fact to the user in anincoming-call sound (an alarm or a melody), a voice, a message orvibrations to stop the reading aloud of the data. When the telephonecall ends, the reading aloud of the book data reopens at the positionwhere it stopped.

[0040] In a timepiece mode, the electronic book device 1 displayscalendar information such as the present date/time on the display unit4.

[0041] Data communication to be performed between the electronic bookdevice 1 and the wearable device 20 will be outlined with reference toFIG. 2. The electronic book device 1 sends call voice data from thetransmitter 16 (FIG. 3) to the wearable device 20 in telephonecommunication. It also sends read-aloud voice data from the transmitter16 (FIG. 3) to the wearable device 20 during book-data reading-aloud andreproduction. The wearable device 20 outputs from the earphones 28 thetelephone-call voice data received in its receiver 26 or the read-aloudvoice data. When there arrives an incoming call, the electronic bookdevice 1 sends an incoming-call reporting command from the transmitter16 to the wearable device 20. The wearable device 20 reports thereception of the incoming call by producing sounds or vibrations inaccordance with the incoming-call reporting command received by itsreceiver 26. When there arrives an incoming call during the readingaloud of the book data, the electronic book device 1 sends the wearabledevice 20 a reproduction stop command to thereby stop reproduction ofthe reading-aloud voice in accordance with the received command.

[0042] Now, referring to FIG. 3 the compositions of the electronic bookdevice 1, the host server 30 installed in the book data delivery centerHS, and the wearable device 20 will be described next.

[0043] As shown in FIG. 3, the electronic book device 1 comprises a CPU2, input unit 3, display unit 4, display driver 5, ROM 6, internal RAM7, external RAM 8, communication I/F (InterFace) 9, antenna 10, rotaryswitch 11, timepiece 12, read-aloud or reciting voice producing unit 13,voice input unit 14, voice output unit 15, and transmitter 16.

[0044] The CPU 2 reads various control programs stored in the ROM 6based on key-in signals given at the input unit 3, temporarily storesthem in the internal RAM 7, and executes various processes based on therespective programs to control the respective elements of the bookdevice 1 in a centralized manner. That is, the CPU 2 executes variousprocesses based on the read programs, stores results of the processes inthe internal RAM 7, produces display data based on the results of theprocesses in display driver 5, and then displays the display data on thedisplay unit 4.

[0045] The CPU 2 reads out from the ROM 6 a program corresponding to atelephone mode, timepiece mode or book mode in accordance withdepression of a corresponding mode switch (not shown) (mode settingprocess) of the input unit 3, and executes a corresponding process (FIG.4) or book data downloading process (FIG. 7).

[0046] In addition to the mode switch to be depressed when one of thetelephone, timepiece and book modes is selected and the dial unit 3 dthat gives an instruction of a dialing process or another respectiveprocess, the input unit 3 includes cursor switches each to input aninstruction of a respective operation, a play switch that gives aninstruction of starting to read book-data aloud, a stop switch thatgives an instruction of stopping to read book data aloud, and a volumeadjust switch. The input unit 3 may optionally include a switch thatgives an instruction of fast feed/rewinding book data, and a page feedkey that gives an instruction of turning the page and feeding a frameintentionally. The dial unit 3 d has a plurality of function keys thatinclude an auto dial switch 3S that is operated to call a preset numberautomatically, and an OK key that is depressed for confirmation purposes(not shown). The auto dial switch 3S is depressed to access the hostserver 30 of the book data delivery center HS to thereby connect a lineautomatically from the communication I/F unit 9 to the host sever 30with the aid of an automatic telephone call unit (not shown) provided inthe communications I/F 9.

[0047] The display unit 4 displays data produced by the display driver 5in accordance with an instruction from the CPU 2. For example, in thebook mode the display unit 4 displays letter/image data, and data suchas book title/author's name related to in the book. In the telephonemode, the display unit 4 displays the other party's telephone number. Inthe timepiece mode, the display unit 4 displays timepiece informationsuch as the present time, date and day of the week. It also displays thecontents of an electronic mail received externally. When there arrivesan incoming call during the book mode, the display unit 4 displays amessage that there has arrived an incoming call based on an incomingcall report from the CPU 2.

[0048] The ROM 6 has stored a basic program and various processingprograms for the electronic book device 1, and processing data in theform of a readable program code in the ROM 6. The processing programsinclude, for example, a mode setting process, a telephone process, atimepiece process, a book process, a book data reading-aloud/reproducingprocess (FIG. 9), a book data select process (FIG. 8) and a book datadownloading process (FIG. 7). The CPU 2 sequentially performs processesin accordance with those program codes.

[0049] The ROM 6 includes a voice data ROM 6A that has stored aplurality of voice waveform data for use in reading aloud book datadelivered externally.

[0050] The voice waveform data includes voice waveform data of analog orPCM (Pulse Code Modulation) type suitable for a voice synthesis systemto be employed by the read-aloud voice producing unit 13, like the voicedata stored in a voice data ROM provided in the external book datadelivery center HS. For example, in a record edition system the ROM 6Ahas stored the waveforms of voices uttered by persons as they are or inthe form of coded data. A unit of a waveform relates to a letter, a wordor a phrase. In a parameter edition system, the ROM 6A has stored aplurality of groups of parameters, each group representing a respectiveone of the waveforms of voices uttered by persons. In a rule synthesissystem, the ROM 6A has stored a plurality of groups of characteristicparameters, each group representing a respective one of small basicunits such as a syllable, phoneme or waveform for one pitch extractedfrom a letter or phoneme symbol string based on phonetic/linguisticrules. It also has stored waveform data representing roars and cries ofanimals, songs of small birds, etc., and sounds produced in the naturalworld (such as sounds of winds, blasts,—sound effects) in addition tohuman beings' voices.

[0051] The read-aloud voice producing unit 13 includes a well-known textvoice synthesis system having, for example, a rule synthesis method thatconverts a text (letters) of book data to voice data. This voicesynthesis system includes a sentence analysis unit, a voice synthesisrule unit, and a voice synthesizer.

[0052] The sentence analysis unit includes a dictionary that has storedmany words, pronunciation symbols, grammar information, and accentinformation. The sentence analysis unit checks a grammatical connectionbetween words in a sentence, analyzes the structure of the sentencewhile checking sequentially the words of the sentence, starting at itshead, for those registered in the dictionary sequentially to separatethe sentence into words, and then gets information such as pronunciationsymbols, grammar information and accents about the respective words.

[0053] The voice synthesis rule unit analyzes changes in pronunciation(phonemic rules) including generation of series of voiced consonants,nasalization, and aphonicness caused by pronunciation of connectedwords, and changes in metrical rules such as shift, loss and occurrenceof accents, and determines phonetic symbols and accents to therebydetermine voice synthesis control parameters. The voice synthesiscontrol parameters include synthetic units (CVC units) such as, forexample, clauses and pauses, and pitches, stresses of and intonationabout voices.

[0054] When the voice synthesis control parameters are determined, thevoice synthesis unit synthesizes a voice waveform based on the synthesisunits and control parameters stored in the voice data ROM 6A.

[0055] The composition of the internal and external RAMS 7 and 8 will bedescribed with reference to FIG. 4. The internal RAM 7 includes a workmemory that temporarily stores a specified processing program, an inputinstruction, input data and a result of the processing (not shown), adisplay register 7 a, a mode data storage area 7 b, a book No. storagearea 7 c, a book data storage area 7 d, a mail data storage area 7 e, asender ID storage area 7 f, an image storage area 7 g that has storedthe images of reciters who include famous voice actors/actresses andother famous persons, and the images of characters appearing in books, avoice data storage area 7 h that has stored voice data of the recitersand a miscellaneous storage area 7 i that has stored dial data, a readstop register, and a timer register.

[0056] The display register 7 a stores display data produced by thedisplay driver 5 and to be displayed on the display unit 4. The modedata storage area 7 b stores mode data set by a corresponding modeswitch. In the electronic book device 1, the user can select any one ofthe telephone, timepiece and book modes. When a mode switchcorresponding to any one of the three modes is depressed, the CPU 2 setsin the mode data storage area 7 b of the internal RAM 7 a modecorresponding to the depressed switch, reads out a correspondingprocessing program from the ROM 6, and starts to execute the program.

[0057] The book No. storage area 7 c stores a number allocated to a book(book No.) selected for reproducing or reading-aloud purpose. The bookdata storage area 7 d stores book data corresponding to the selectedbook No. The mail data storage area 7 e stores the contents (letterdata, image data, etc.) of an electronic mail received externally.

[0058] The sender ID storage area 7 f stores a sender ID of theelectronic book device 1 as a sender. The sender ID includes, forexample, an ID/registration code of the book device given by the hostserver 30 or a personal code (serial number) given to the electronicbook device 1 concerned. When desired book data is to be downloaded, thecommunication I/F unit 9 sends the host server 30 a delivery request andthe sender ID.

[0059] The miscellaneous storage area 7 i stores registered telephonenumber data in a dial data storage area portion thereof, for example, atelephone number used to connect to the host server 30 in the book datadelivery center HS, and telephone numbers of third parties.

[0060] The timepiece register portion of the storage area 7 isequentially updates and stores date and time data recorded in thetimepiece unit 12.

[0061] The read stop register portion of the storage area 7 i storesinformation on a position where reading the book data aloud stopped dueto arrival of an incoming call.

[0062] The external RAM 8 comprises a magnetic or optical recordingmedium or a semiconductor memory provided fixedly or removably to theelectronic book device 1. When portability of the electronic book device1 is considered, it should preferably include a memory card composed ofa small portable semiconductor memory. The external RAM 8 includes abook data storage area 8 a that stores a plurality of book data and bookNos. received externally.

[0063] Book data stored in the external RAM 8 includes, for example,ones downloaded from the delivery center HS and written by an externaldevice such as a PC. A user can select desired book data from theplurality of book data stored in the external RAM 8 and cause theselected book data to be reproduced in a desired voice represented bycorresponding voice data stored in the ROM 6A

[0064] The communication I/F unit 9 comprises a mobile communicationunit capable of performing telephonic and data communication with anexternal device such as a portable telephone/PHS. The communication I/Funit 9 communicates telephonic data/electronic mails with an externaldevice, and communicates various data to the book data delivery centerHS to download desired book data. When the antenna 10 detects arrival ofan incoming call, it delivers an incoming call detection signal to theCPU 2.

[0065] When a talk switch (not shown) provided on the dial unit 3 d isoperated after the arrival of an incoming call is detected by thecommunication I/F unit 9, the CPU 2 starts a call process. When a calleeis specified by operation of the dial unit 3 d, a call signal is sent tothe callee. When the callee responds to the call signal, a communicationprocess starts.

[0066] When the auto dial switch 3S provided on the dial unit 3 d isoperated, an automatic telephone call unit (not shown) of thecommunication I/F unit 9 automatically connects to the host server 30provided on the book data delivery center HS. The communication I/F unit9 then communicates data with the host server 30.

[0067] In the voice reproduction system 100 of FIG. 3, the data to becommunicated between the book data delivery center HS and the electronicbook device 1 includes, for example, the book data that the host server30 sends out, and a request for delivery of book data to be sent to thedelivery center HS. When the communication I/F 9 sends the request fordelivery of book data to the host sever 30, it also sends the sender IDof the electronic book device 1 simultaneously.

[0068] The communication I/F 9 may have a connector and cable to connectthe electronic book device 1 thereof to a mobile phone/PHS withoutdirectly providing the mobile communication unit including the mobilephone/PHS to the book device 1, or a communication interface such as aninfrared/wireless communication unit to connect to external datacommunication terminals such as, for example, a book data deliveryterminal and a PC comprising a modem/TA (Terminal Adapter).

[0069] The rotary switch 11 is operated manually by the user andincludes a single input button having rotary and depressing functions.In the rotary operation, a picture displayed on the display screen ofthe book device is scrolled/the cursor position is moved in the rotarydirection of the button in connection with the rotation of the button.In the depressing operation, a selected or inverted display item (cursorposition) is fixed. Thus, the user can easily select and fix aregistered dial number and book data.

[0070] The timepiece 12 records or counts a time and a date, and thisdata is delivered via the CPU 2 to the timepiece register 7 h of theinternal RAM 7 to update the old data. For example, the timepiece 12 maycomprise an oscillator (not shown) that generates an electric signalhaving a predetermined frequency, and a divider (not shown) that dividesthe signal into lower frequencies to be counted to record the presenttime.

[0071] The voice input unit 14 converts an analog voice signal based onthe user's voice picked up by the microphone 1C to a digital signal thatis then delivered to the CPU 2.

[0072] The voice output unit 15 outputs a telephone call signal receivedvia the communication I/F 9 from the other party to the speaker 1E ortransmitter 16. The voice output unit 15 also outputs read-aloud voicedata produced by the read-aloud voice producing unit 13 to the speaker1E or transmitter 16.

[0073] The transmitter 16 communicates with a receiver 26 of thewearable device 20, which includes an infrared or wireless communicationunit, for example. The transmitter 16 sends the wearable device 20telephone-call voice data/read-aloud voice data produced by theread-aloud voice producing unit 13. The transmitter 16 also sends thewearable device 20 incoming-call reporting command and reproduction stopcommand data received from the CPU 2.

[0074] The specified composition of the wearable device 20 will bedescribed next with reference to FIG. 3. The wearable device 20comprises a CPU 21, a manual input unit 22, an incoming-call reporter23, an internal RAM 24, a ROM 25, a receiver 26, a voice output unit 27,and earphones 28.

[0075] The CPU 21 controls the respective elements of the wearabledevice 20 in a centralized manner in accordance with various commandsignals (incoming-call reporting command, reproduction stop command,etc.) received by the receiver 26 thereof. In more detail, when the CPU21 receives read-aloud voice data based on book data/telephone callvoice data in the receiver 26, it transfers those voice data to thevoice output unit 27 to thereby cause the earphones 28 to output thevoice data audibly. When the CPU 21 receives the incoming-call reportingcommand in the receiver 26, it reports the arrival of the incoming-callto the incoming-call reporter 23, using a display, sounds and/orvibrations. When the CPU 21 receives the reproduction stop command, itcauses the outputting of the read-aloud voice to be stopped.

[0076] The incoming-call reporter 23 comprises a ringer that rings thearrival of an incoming call, a vibrator that signals the arrival of theincoming call by vibrations, and a liquid crystal display that displaysthe arrival of the incoming-call signal, and/or a combination of any twoor more of those elements. The incoming call reporter 23 reports thearrival of an incoming-call in accordance with the incoming-callreporting signal from the CPU 21 in the wearable device 20.

[0077] The internal RAM 24 comprises a work memory that temporarilystores various data received from the receiver and data inputted at theinput unit 3. The ROM 25 comprises a semiconductor memory that hasstored basic processing programs to be executed by the wearable device20.

[0078] The receiver 26 comprises an infrared or wireless communicationunit provided so as to communicate with the transmitter 16 of theelectronic book device 1. The receiver 26 receives read-aloud voicedata, telephone call voice data, incoming-call reporting command, and areproduction stop command, and delivers such data to the CPU 21.

[0079] The voice output unit 27 comprises an amplifier that outputs thevoice data (read-aloud voice data and telephone call voice data)received by the receiver 26 to the earphones 28 in accordance with aninstruction from the CPU 21. The earphones 28 output a voice based onvoice data from the voice output unit 27.

[0080] The manual input unit 22 is composed of operation keys (notshown) to control the electronic book device 1 remotely and atransmission unit (not shown) that sends a remote control signalproduced by operating one of the keys to the electronic book device 1.In this respect, the electronic book device 1 also comprises a receptionunit (not shown) that receives the remote control signal. Display ofbook data, a start and stop of reproduction of a voice reading aloud thebook data in the electronic book device 1 may be controlled remotely bythe manual input unit 22 of the wearable device 20.

[0081] The specified composition of the host server 30 provided in thebook data delivery center HS will be described next. As shown in FIG. 3,the host server 30 comprises a book data ROM 32 that has stored aplurality of book data, a delivery unit 33 that delivers book datarequested by an electronic book device 1 to this book device, a transferunit 34 that communicates various data with the electronic book device 1or telephone terminal 44, and a CPU 31 that controls delivery of bookdata stored in the book data ROM 32 to a requesting terminal.

[0082] As shown in FIG. 5, the book data ROM 32 comprises a storage area32A that has stored letter data composing book data, images ofcharacters appearing in the books, and sound effect data. The book dataROM 32 also comprises a name storage area 32B that has stored the names(A), (B), (C), . . . (N) of a plurality of reciters who include famousor popular persons, voice actors/actresses, etc., A, B, C, . . . N,whose images N21, N22, N23, . . . N34, are to be used to read aloud theletter data stored in the book data storage area 32A, a reciter imagestorage area 32C that has stored the plurality of images of the recitersand a voice data storage area 32D that has stored a plurality of voicedata a, b, c, . . . and n representing the respective voices of thereciters.

[0083] In more detail, the respective reciter images stored in the imagestorage area 32C comprise face images (FIG. 11A) and fill-length figuresof the famous voice actors/actresses and other famous persons, theimages of animals, the images of virtual plants that utter their voices,and the images of famous animation or comic characters. The voice datastored in the voice data storage area 32D comprises recorded analog ordigital data obtained from voices uttered by the famousactors/actresses, other famous persons, etc. The reciter images N21,N22, N23, . . . N34 of the famous acotors, etc., A, B, C, . . . N storedin the storage area 32C are placed in corresponding relationship totheir voice data a, b, c, . . . n stored in the storage area 32D undertheir respective names.

[0084] When the CPU 31 receives a request for delivery of book data fromthe electronic book device 1, PC or book data delivery terminal 42, theCPU 31 reads out from the book data ROM 32 information on the requestedbook data (book title, author's name, publishing company's name,character and reciter images, reciter voice data) and delivers thosedata to the requesting terminal from the delivery unit 33.Simultaneously, the CPU 31 also sends data on a charge for these data tothe terminal. When the terminal admits the charge, the CPU 31 reads outthe requested book data from book data ROM 32 and sends it to theelectronic book device 1 or terminal.

[0085] A specified composition of each of copyright holder terminals 30Bprovided in the network will be described next. As shown in FIG. 3, thecopyright holder terminal 30B comprises a work data RAM 30BR that hasstored a plurality of work data, a transmitter 30BS that sends this datato the host server 30 provided in the delivery center HS, and a CPU 30BCthat controls the respective elements of the copyright holder terminal30B including the transmitter 30BS and work data RAM 30BR.

[0086] The work data comprises the images of the reciters who includefamous persons, voice actors/actresses, famous animation characters,etc., their names and voice data representing their voices.

[0087] The copyright holder terminal 30B is owned by its copyrightholder who includes an author who created the book data, famous personswhose images are used as read-aloud persons or reciter images, and amanagement company that manages a copyright of the reciter images andthe right of its likeness.

[0088] Operation

[0089] The inventive electronic book device 1 executes processescorresponding to the respective modes set in the mode setting process.When the power supply is on, the electronic book device 1 is set in thetimepiece mode in which the timepiece 12 records the present time, andalso waits for a mode switch to be depressed, at which time the modesetting process starts.

[0090] The CPU 2 determines the kind of the depressed mode switch. Whenmode switches corresponding to the telephone, timepiece and book modesare depressed, the respective corresponding processes are executed.

[0091] The telephone, timepiece and book processes in the correspondingmodes and a process for selecting and downloading desired book data willbe respectively described next:

[0092] (Telephone Process)

[0093] The telephone process to be performed to make a telephone call toa person or callee (part 1) and the telephone process to be performedwhen the book device is called by a person (part 2) will be describednext. When the electronic book device 1 makes a telephone call to aperson or callee in the telephone process (part 1), the telephone modeswitch is depressed

[0094] Then, when a desired callee's telephone number is inputted at thedial unit 3 d, or when a desired callee's number is selected from amongthe telephone number data stored in the dial data storage area of theinternal RAM 7, or when the auto dial switch 3S is operated to dial thebook data deliver center HS to thereby to turn on a dial switch (talkswitch) of the dial unit 3 d, the communication I/F 9 sends a callsignal to the inputted or selected callee. When the callee or thedelivery center HS responds to the call signal and the book data device11 is connected to the callee or the delivery center HS, the telephonecall process is executed.

[0095] In the telephone call process to the callee, the user's voiceinputted to the microphone 1C is converted by the voice input unit 14 toa digital signal, which is then modulated and sent via the communicationI/F 9 to the callee. Then a signal from the callee is received by thecommunication I/F 9 and delivered to the CPU 2. This signal is thenconverted by the voice output unit 15 to a voice signal that is thenaudibly output from the speaker 1E or sent from the transmitter 16 tothe wearable device 20 to thereby cause the earphones 28 to output acorresponding voice in an appropriate volume. The CPU 2 may display onthe display unit 4 telephone call data such as the callee's telephonenumber, name and an elapsed communication time during the telephonecall.

[0096] When there arrives an incoming call from an external callerduring the use of the electronic book device 1 in the timepiece or bookmode, the telephone process (part 2) starts. When the communication I/F9 detects the arrival of the incoming call and delivers a correspondingdetection signal to the CPU 2, the CPU 2 determines whether the bookdata is under reproduction at present. If it is, the CPU 2 delivers tothe transmission unit 16 a reproduction stop command to stopreproduction of the book data. At this time, the CPU 2 stores data on aposition on the book page, where the reading aloud of the book datastopped, in the incoming call register 7 i of the internal RAM 7. TheCPU 2 also delivers to the transmission unit 16 data to report thearrival of the incoming call. The transmission unit 16 then sends thewearable device 20 the reproduction stop command and the incoming callreport command. The wearable device 20 stops reading-aloud orreproduction of the voice output unit 27 and reports the arrival of theincoming call with the aid of the incoming call reporter 23, based onthe received reproduction stop command and incoming call report command,respectively. The arrival of the incoming call is reported, for example,by a predetermined sound or message voice (stored in ROM 25) or invibrations given by the vibrator. The electronic book device 1 maydisplay a message reporting the arrival of the incoming call on thedisplay unit 4.

[0097] Then, when the incoming call is responded by depressing the talkswitch, the telephone call process starts. When the telephone call ends,the CPU 2 reads out the data on the position o the book page where thereading-aloud of the book data stopped from the read stop register 7 iof the internal RAM 7 to reopen the read-aloud or reproduction of thebook data at that position to thereby restore the normal book mode andto terminate the telephone process (part 2).

[0098] When no book data is being read aloud or reproduced at thearrival of the incoming call, the arrival of the incoming call isreported. When the incoming call is responded by depressing the talkswitch, the telephone call process is performed. When the telephone callis terminated, the timepiece mode is restored to thereby terminate thetelephone call process (2).

[0099] (Timepiece Process)

[0100] The timepiece process to be performed in the set timepiece modewill be described next. When calendar information such as the presentdate/time is displayed on the display unit 4, using the electronic bookdevice 1, the timepiece mode is set by operating the corresponding modeswitch. In more detail, the CPU 2 sets the timepiece mode in the modedata storage area 7 b of the internal RAM 7, refers to the present timecounted by a time counter 12, updates data in the time count register 7h of the internal RAM 7, and outputs the present time data to thedisplay driver 5. The display driver 5 produces the present date/timedata, stores same in the display register 7 a of the internal RAM 7 anddisplays it on the display unit 4.

[0101] As described above, by simple depression of the mode switch thetimepiece mode is selected instantaneously to thereby display thepresent date/time on the display unit 4.

[0102] (Book Process)

[0103] Referring to FIG. 7, the processes to be performed by theelectric book device will be described next. FIG. 7 is an overallflowchart illustrating the respective processes performed by theelectronic book device, book data delivery center and copyright holderterminal. FIG. 8 is a flowchart illustrating a process for selectingbook data and a reciter image. FIG. 9 is a flowchart illustrating aprocess for reading aloud or reproducing book data.

[0104] Reading aloud or reproducing the book data stored in theelectronic book device 1 using voice data stored in the voice data ROM6A of the electronic book device 1 will be described.

[0105] When desired book data selected from among the plurality of bookdata stored in the external RAM 8 is to be read aloud or reproduced inthe electronic book device 1, the book mode switch is depressed

[0106] In response, the CPU 2 reads out all the data related to thebooks stored in the external RAM 8 and displays the read data on thedisplay unit 4. For example, as shown in FIG. 10A, the CPU 2 indicates amessage M2 “Please select a desired book”, all book Nos. and titles suchas “1. Book title (a)”, “2. Book title (b)”, . . . and a pointer P toselect the desired book.

[0107] When a book to be reproduced or its title is selected byoperating the cursor switch of the input unit 3 or the rotary switch 11,and the depress switch is then depressed, the CPU 2 reads out book datacorresponding to the selected book title from the external RAM 8 andstores the data in the book data storage area 7 d of the internal RAM 7.

[0108] The CPU 2 transfers text data on a first page (cover page) of theread-out book data to the display driver 5, which produces correspondingdata to thereby be displayed on the display unit 4. The CPU 2 then givesthe read-aloud voice producing unit 13 a read-aloud start command, usingvoice data stored in the voice data ROM 6A, and performs a process forreading aloud or reproducing the book data in a voice represented bystored relevant voice data.

[0109] Referring to FIG. 7, a process to be performed by the book datadelivery center HS for the user to download desired book data from thebook data delivery center HS onto the user's electronic book device 1will be described next along with data communication performed betweenthe user's electronic book device 1 and the book data delivery centerHS.

[0110] First, the user of the electronic book device 1 accesses ahomepage of the book data delivery center HS, for example, via theInternet 40 and sends a request for delivery of a desired book and theuser ID to the delivery center HS (step F1). The CPU 31 of the hostserver 30 receives these data (step F2), and stores these data in theRAM 31A In order to display on the electronic book device 1 a bookselect picture that urges the user to select a desired book, the CPU 31of the host server 30 sends back the book select picture data (includingdata related to the book data) to the requesting terminal or theelectronic book device 1 (step F3).

[0111] When the electronic book device 1 receives the book selectpicture data, it displays on the display unit 4 a book select picturecorresponding to the received book select picture data, and then theuser selects book data on the book select picture (step F4 in FIG. 7A)to download desired book data from the book data delivery center HS.

[0112]FIG. 8 is a flowchart of the book data select process to beperformed by the electronic book device 1. FIG. 10A illustrates a bookselect picture to select book data to be downloaded.

[0113] In order to download the book data, the book select process ofFIG. 8 is performed. When the auto dial switch 3 s is depressed in theelectronic book device 1, the automatic telephone call unit provided inthe communication I/F 9 connects a line automatically from theelectronic book device 1 to the book data delivery center HS. Thecommunication I/F 9 sends the book data delivery center HS a request fordelivery of desired book data and the sender ID of the electronic bookdevice 1 thereof. When the book data delivery center HS receives thesedata, it sends back data related to deliverable book data (book titles,author names, publishing company's names, etc.) to the electronic bookdevice 1.

[0114] When the electronic book device 1 receives the book-related datavia the communication I/F 9 from the book data delivery center HS, theCPU 2 displays on the display unit 4 a book select picture that containsthe book-related data, as shown in FIG. 10A

[0115] The book select picture displayed on the display unit 4 containsa message M2 to urge the user to select book data to be downloaded:“Please select a desired book”, and all data G1, G2, G3 . . . related todeliverable book data. For example, data G1 related to book No. 1contains book title (a): “USA CONSTITUTION”; data G2 related to book No.2 contains book title (b): “GONE TOGETHER WITH THE SOUND”; and data G3related to book No. 3 contains book title (c): “COMIC: EDISON, THE KINGOF INVENTORS: (BIOGRAPHY)”.

[0116] The displayed pointer P can be moved to a position of a desiredbook title by operating the cursor switch or the rotary switch 11 and adecision switch(not shown) can be operated to select the desired bookfrom the related data.

[0117] When the desired book is determined (YES in step E2), the CPU 2stores the book No. of the selected book in the internal RAM 7 (stepE3). Simultaneously, the CPU 2 sends a request for delivery of theselected book, the selected book No. and the sender or user ID via thecommunication I/F 9 to the book data delivery center HS.

[0118] When the book data delivery center HS receives these data, itreads out from the book data ROM 32 book data (containing a plurality ofcharacter images appearing in the book data) corresponding to theselected book No., and the images of the famous persons, etc., asreciters, and sends these data to the electronic book device 1 that sentthe sender ID via the Internet 40 to the delivery center.

[0119] When the electronic book device 1 receives these data, it storesthe data in the internal RAM 7 a. Then, the electronic book device 1displays on the display unit 4 the images of the characters 402 and 403of the received book data, as shown in FIG. 10B (step E4). Then, when apredetermined time elapses, images of reciters N21-N25 are displayedtogether as shown in FIG. 11A (step E5).

[0120] Then, when a further predetermined time elapses, the electronicbook device 1 urges the user to select and allocate desired two of thereciter images N21-N25 to the character images 402 and 403,respectively, as shown in FIG. 11B step E6).

[0121] Thus, the user selects and decides the desired reciter images(step E7). Then, the book device 1 stores those decided reciter imagesin the corresponding area 7 g of the RAM 7 (step E8). For example, whenthe user selects a reciter image N22 of the famous persons B from amongthe reciter images N21-N25 of the famous persons A . . . N of FIG. 11Aand allocates this reciter image to the character image 402 of “Miss X”appearing in the book data, as shown in FIG. 11B, the character image402 for “Miss X” and the reciter image N22 are stored in correspondingrelationship in the area 7 g of the RAM 7. Likewise, when a reciterimage N21 of the famous person A is allocated to a character image 403of “Mr. Y” appearing in the book, the character image 403 for “Mr. Y”and the reciter image N21 are stored in corresponding relationship inthe area 7 g of RAM 7. Then, the book data and reciter image selectingprocess is terminated.

[0122] Referring back to FIG. 7, a process for downloading the book datais performed. To this end, the auto dial switch 3S of the electronicbook device 1 is depressed. In response, the automatic telephone callunit of the communication I/F 9 automatically connects a line from thecommunication I/F 9 to the book data delivery center HS. Thecommunication I/F 9 then sends a request for delivery of book data andthe sender ID of the electric book device 1 thereof to the book datadelivery center HS.

[0123] When the book data delivery center HS receives these data, itsends the book device 1 an acknowledgement of those data and datarelated to deliverable book data such as book titles.

[0124] When the electronic book device 1 receives these data via thecommunication I/F 9, the CPU 2 of the book device 1 displays these dataon the display unit 4. The book device 1 then sends the book deliverycenter HS the book No. selected on the book select picture, along withthe sender ID of the book device 1 (step F5).

[0125] When the host server 30 receives those data from the electronicbook device 1 (step F6), it stores the data in the RAM 31A, reads out amessage about the acknowledgement of the book No. selected from amessage ROM not shown) of the host server 30, and then sends the messageback to the electronic book device 1 (step F7).

[0126] The electronic book device 1 displays this message on the displayunit 4 (step F8).

[0127] The host server 30 then sends the electronic book device 1 bookdata for the book No., reciter images, and their voice data selected inthe electronic book device 1 (step F9).

[0128] The electronic book device 1 downloads the book data, reciterimages, and their voice data into the book data storage area 7 d,reciter image storage area 7 g and voice data storage area 7 h,respectively, of the RAM 7 thereof for each book No. (step F10). Whenthis downloading process ends, the electronic book device 1 sends thehost server 30 data indicative of completion of the data downloading(step F11).

[0129] Then, the host sever 30 sends the electronic book device 1 dataon bill data about the sum of the price of the book data, reciterimages, etc., and a delivery charge cost to download the book data, etc.(step F12). The electronic book device 1 displays this bill data on thedisplay unit 4 (step F13). The electronic book device 1 performs aprocess for settling accounts with the host sever 30 for the bill data.There are various accounts settling methods. For example, the electronicbook device 1 can request a financial institution to pay the host server30 for the bill (step F14).

[0130] The host server 30 sends the electronic book device 1 the billdata and informs the copyright holder terminal 30B of the sale of theelectronic book via the Internet 44 (step F22). The copyright holderterminal 30B receives this information from the host server 30 (stepF23). The “copyright holder” referred to here includes an author whocreated the book data, the famous persons, voice actors/voice actresses,whose images were used as the reciter images, and a managing companythat manages the copyright of the reciter images and the right of theirlikeness.

[0131] Then, a process for reading aloud and reproducing the book datais performed as shown in FIG. 9 (step F14), which will be describednext.

[0132] The CPU 2 of the electronic book device 1 determines whether ornot the delivered book data stored in the book data storage area 7 d ofthe internal RAM 7 is of the cartoon or comic type in the book datareciting or reproducing process. If it is (YES in step D1), the CPU 2reads out the title, author's name and contents data from the book datastorage area 7 d and displays those data on the display unit 4 (stepD2). Then, as shown in FIG. 12A the CPU 2 extracts from the RAM 7 theimages 402 and 403 of the characters appearing in the book, their names(Miss X, M. Y) included in the book data and the corresponding reciterimages N21 and N22, and displays these images on the display unit 4(step D3).

[0133]FIG. 12A illustrates a start of reproduction of comic book data.As shown, a title of a book 401 is displayed as “COMIC: EDISON, THE KINGOF INVENTORS (BIOGRAPHY)” along with an image 402 of “Miss X”, characterNo. 1. Likewise, an image 403 of Mr. Y, character No. 2, is displayed.Reciter images N21 and N22 stored in the RAM character storage area 7 gand selected by the user are displayed.

[0134] The CPU 2 then sets a page counter M to an initial value “1”(step D4), sets a frame counter N to an initial value “1” (step D5),reads out from the book data storage area 7 d book data includingcharacter No., balloon, illustration, background image, letter and soundeffect data contained in a first frame on a first page, and displays acharacter (“Mr. Y”) 403, a balloon 409, an illustration, a backgroundimage 406, and letters 408 contained in the balloon 409 (step D6) basedon those data, as shown in the first or right frame of FIG. 12B.

[0135] The read-aloud voice producing unit 13, the voice output unit 15and the speaker 1E cooperate to read out the book or letter data in theballoon 409 in the voice of the reciter N21 allocated to the characterMr. Y based on the reciter's voice data stored in the RAM voice datastorage area 7 h (step D7). For example, FIG. 12B illustrates that arecitation “This is the house where Edison was born.” represented by theletters 408 in the first balloon 409 is being reproduced from theearphones 28 in the voice of the reciter image N21 allocated to “Mr. Y”or character image 403.

[0136] The CPU 2 displays the color of letters being at present readaloud in the balloon 409 in the reading-aloud voice in a different colorfrom that of the remaining letters (step D9). For example, FIG. 12Billustrates in its first or left frame that a word “Edison” 416contained in the letters 408 in the balloon 409 is being at presentreproduced audibly from the earphones 28 and also displayed in a colordifferent from that of the remaining letters in the balloon 409.

[0137] After the voice reproduction for the balloon 409 is completed,the CPU 2 further determines whether there remain any more balloons inan N^(th) frame (here, first frame) (step D10). If there do (YES in stepD10), the control returns to step D7 to iterate steps D7-D9.

[0138] The read-aloud voice producing unit 13 delivers the reciter voicesignal along with the sound effect signal via the voice output unit 15to the transmitter 16, which then sends the voice signal wirelessly tothe wearable device 20 through the windows concerned. The wearabledevice 20 receives the voice signal in its receiver 26 and outputs itfrom the earphones 28 audibly (step D8).

[0139] Therefore, the user can hear words or sentences in the book“COMIC: EDISON, THE KING OF INVENTORS (BIOGRAPHY)” being read aloud orrecited in the voice of the reciter who was the selected favorite famousperson, inclusive of the sound effects.

[0140] Then, when there remain no more balloons in the N^(th) frame(here, first frame) (NO in step D10), the CPU 2 increments the framecounter (N+1→N in step D11).

[0141] The CPU 2 then determines whether all the letter data containedin the page has been read aloud step D12). If it has not, (NO in stepD12), the CPU 2 iterates processes in steps D6-D11 about the (N+1)^(th)frame. That is, the CPU 2 displays the (N+1)^(th) or left frame (in FIG.12B) at the center of the display picture by scrolling, and controls thevoice reproducing unit so that the text (letters) contained in a balloon410 contained in the displayed frame is read aloud, that sound effectdata is reproduced, and that the portion of the text being read aloud atpresent in the balloon is displayed in a color different from theremaining text (letter) data.

[0142] The left or second frame displays “Miss X” or character image402, an illustration or a background image 407, letters 411 and aballoon 410 that contains the letters. The letters 411 in the balloon410 represent the words that “Mr. A” utters.

[0143] Like the first frame, the second frame indicates that arecitation “A gramophone No. 1 was also completed as a result of aseries of experiments.” is being reproduced from the earphones 28 in thevoice of the reciter image N22 allocated to the image 403 of thecharacter “Miss X”, based on the processing in step D7. In step D8 thesecond frame indicates that voice data “Mary's lamb” or sound effectdata output from the gramophone is being output from the earphones 28 inthe voice of the reciter image N22 in step D8.

[0144]FIG. 12B shows a two-frame cartoon. The number of frames of thecartoon is not limited to two and may be either one or more than two sothat the number of frames displayed on a singlle page may be changeddepending on the size of frames used, as requested.

[0145] When all the texts (letter) data contained in the frames of thedisplayed page have been read aloud (YES in step D12), the CPU 2increments the page counter M (M+1→M in step D13). If all the pages havenot been read aloud (NO in step D14), the CPU 2 displays a next page byscrolling and sequentially causes text (letter) data in the displayedframes to be read aloud, starting with the first frame.

[0146] The CPU 2 produces and displays on the display unit 4 data on aM^(th) page based on the book data stored in the book data storage area7 d of the internal RAM 7. The CPU 2 iterates steps D5-D13 to reproducetext (letters) data contained in the respective N frames contained inthe M^(th) page in a voice corresponding to a reciter and a sound effectcorresponding to effect sound data, and displays the letters in theballoon being read aloud in a color different from that of the remainingletters. In synchronism with the advance of these voices, the CPU 2scrolls and displays the frames.

[0147] Then, when the CPU 2 determines that all the pages have been readaloud or reproduced (YES in step D14), it terminates the reading-aloudor reproducing process. When the book data is not of the cartoon orcomic type in step D1, but for example, of the novel or story type, theCPU 2 performs the following processes (steps D15-D21).

[0148] First, the CPU 2 reads out data on a title of a book, theauthor's name and a table of contents from the book data storage area 7d, and displays those data on the display unit 4 (step D15). The CPU 2then extracts a narrator image or name from the book data, and displaysit step D16 in FIG. 13A).

[0149] In more detail, FIG. 13A illustrates a picture in which a reciterimage is to be selected when reproduction of a book of a story typestarts. In FIG. 13A, a title of a book “GONE TOGETHER WITH THE SOUND”420 is displayed as an example. Also, an image 421 of narrator R and animage 422 of narrator S are displayed along together with a reciterimages N23 of famous person C and reciter image N25 of famous person Dallocated to the respective narrator images 421 and 422 by the user.

[0150] One of the narrator images is selected with the cursor 23 of theinput unit 3, at which time the selected narrator image, and the reciterimage and voice data allocated to the narrator image are set in theinternal RAM 7, an initial value of the page counter n is set to initialvalue “1” (step D17), and the book data on page “1” is displayed on thedisplay unit 4.

[0151] The CPU 2 causes the narrator image to read aloud letter data 425contained in the book data on the page “1” in the voice of the famousperson represented by the reciter image allocated to the narrator imagestep D18).

[0152] For example, when the narrator image S is selected in FIG. 13A,the CPU 2 gets voice data on the reciter image N25 allocated to thenarrator image S and sets the data in the internal RAM 7. Then, as shownin FIG. 13B the CPU 2 displays on the display unit 4 text (letter) data425 on a first page of the book, transfers this data to reading-aloudvoice producing unit 13.

[0153] The voice producing unit 13 reads aloud the letter data as if thenarrator image S narrates the content of the book concerned in a voicerepresented by the voice data of the famous person represented by thereciter image N25.

[0154] At this time, the CPU 2 displays the color of the part of thetext (letters) 426 being read aloud in synchronism with thereading-aloud voice of the narrator image S (actually, the voice of thereciter image N25) in a color different from that of the remaining textportion. For example, when a reciting sound “léft” is being outputaudibly from the earphones 28, the word “left” 426 of the text isdisplayed on the display unit 4 in a color different from that of theother words.

[0155] Sound effect data not included in the letter data may be insertedinto the letter data as requested. For example, as shown in FIG. 13B aunique sound “Ta:” produced when the “narrator image S” beats his deskwith a folded fan to rearrange his tone may be output audibly from theearphones 28 during the reproduction. Alternatively, sound effect datamay be included in the book data so as to be produced at a predeterminedtiming such that the text may be narrated along with effect sounds suchas the sounds of a temple bell/the singing of insects.

[0156] Then, when reading aloud all the text (letter) data on the M^(th)page is completed (YES in step D19) the CPU 2 increments the pagecounter M (M+1→M in step D20) and determines whether all the pages havebeen read aloud (step D21). If they have not, the CPU 2 displays a nextpage by scrolling and then returns the control to step D20 to read aloudletter data on the displayed M^(th) page. Then, when all the pages havebeen read aloud (YES in step D21), the CPU 2 stops reproduction tothereby terminate this process.

[0157] When the stop switch is turned on during reproduction of the bookdata, reproduction of the book data is stopped and terminated.

[0158] As described above, according to the inventive electronic bookdevice 1 the displayed frames and pages are scrolled in synchronism withthe advance of the reading-aloud voice, so that the user need not turnthe page/feed frames intentionally. Thus, the user can enjoy readingcomfortably at the electronic book device 1.

[0159] The copyright holder terminal 30B is connected via the network 40to the host server 30. The copyright holder terminal 30B stores in itswork data RAM 30 BR work data that includes the images of reciters who,in turn, include famous persons, voice actors/actresses, etc., theirnames and voice data. Then, the copyright holder terminal 30B sends thework data via the network 40 to the host server 30 (step F20). Then, thehost server 30 receives this work data and registers same in the RAM31A. Each time the host server 30 receives work data from the copyrightholder terminal 30B, the host server 30 publishes the data in thehomepage thereof (step F21).

[0160] The work data published in the homepage (HP) of the host server30 can be utilized at a request from the electronic book device 1 (stepF1). A result of utilizing the work data is reported to the copyrightholder terminal 30B from the host server 30 (step F22). The copyrightholder terminal 30B receives the report from the host server 30 (stepF23). As the electronic book device 1 downloads electronic book data,the host server 30 reports to the copyright holder terminal 30B a resultof settling a bill for the total of the price of the book data and acharge for the delivery of the book data (step F24). After receiving thereport the copyright holder terminal 30B can receive a correspondingcopyright fee (step F25).

[0161] If the copyright holder terminal 30B then newly stores in itswork data RAM 30BR work data that includes reciter images of famousactors/actresses, entertainers, Nobel prize winners and famous sportsmenand sportswomen, their names, and voice data representing their voices,the copyright holder terminal 30B sends the work data as updated one tothe host server 30 via the network 40 (step F26). The host server 30receives and stores this data in the RAM 31A and sends this data at arequest of the book device(step F16).

[0162] As described above, each time the host server 30 receives theupdated work data from the copyright holder terminal 30B, the hostserver 30 publishes the data in the homepage thereof(step F21). Thus,the electronic book device 1 can store the images and voice data of thereciters as the updated work data in the internal and external RAMS 7and 8 thereof. Therefore, the electronic book device 1 can rapidly andeasily utilize the data as new reciter images and their voice data to beallocated to characters appearing in the book data delivered by the hostserver 30 (steps F1-F17).

[0163] As described above, in the book process desired book data andvoice data can be read out from the external RAM 8 to thereby be readaloud in a voice represented by the voice data. A plurality of book dataand voice data downloaded externally is stored in the internal RAM 7.

[0164] If there arrives a telephone call during reading aloud of thebook data, the CPU 2 outputs a command to report the arrival of thetelephone call and a command to stop reading aloud the book data tothereby cause the corresponding process to be performed. The CPU 2stores in the read stop register 7 i a position on the page where thereading-aloud of the book data has stopped. When the telephone callends, the CPU 2 reopens reading-aloud the book data at the storedposition where the reading-aloud of the book data stopped.

[0165] The CPU 2 then determines the type of book data and changes theunit of display. For example, if the book data is of the cartoon orconic type, it can be displayed in frames, for example, in units of twoframes in each of which the reciter image allocated to the character inthe book reads aloud the text (letter data) in his or her voice. The CPU2 can also change the manner of setting the kind of reading-aloud voicedepending on the determined book data type. If the book data is ofanother type, it can be displayed in units of a page and the reciterimage specified by the user reads aloud the book data in his or hervoice. During reading-aloud of the book data, the frames and page underdisplay scroll in synchronism with the advance of the reading-aloudvoice.

[0166] As described above, the electronic book device 1 can easilydownload and acquire desired book data and related voice dataexternally. Therefore, the user can visually enjoy reading the displayedbook data in silence as well as hearing the book data being read aloudin a voice corresponding to the voice data.

[0167] When there is an arrival of a telephone call during reading-aloudof book data, this fact is reported and the reading-aloud of the bookdata is automatically stopped. Thus, the user can rapidly respond to thetelephone call. The position where the reading-aloud of the book datastopped at the arrival of the telephone call is stored and when thetelephone call ends the reproduction of the book data reopensautomatically at the position where the telephone call stopped. Thus, nomanual operations are required to reopen the book reading, conveniently.

[0168] When the book data is of the cartoon or comic type, the images ofcharacters appearing in the book, sentences (letter data uttered by theimages, and balloons that contain the letter data are displayed in unitsof a frame, the letter data in the displayed balloon is read aloud inthe voices of the reciter images allocated to the characters. Whenreading-aloud the letter data in the balloon ends, the control passesautomatically to a step to process another frame in a scrolling manner.Thus, it is unnecessary to turn the page/feed the frame, and theoperation is simplified.

[0169] Since the book content represented by the book data is read aloudin the voices of the reciter images allocated to the book characters,one character can be discriminated from another and the user can enjoyreading the book without resorting to his or her eyesight.

[0170] Since the present letter data being read aloud is displayed so asto be distinguishable in color from other letter data, the data can beeasily confirmed. For example, even when the displayed image and lettersare alternately viewed, the present book data being read aloud at thattime can be easily recognized when the user shifts his or her eyesightfrom the image to the letters to thereby provide comfortable reading.

[0171] In a book of a novel or story type, the letter data to be readaloud is displayed in units of a page, and read aloud in the voice of areciter image specified by the user. When reading aloud the letter datais completed, a next page appears (is displayed by scrolling). Thus, itis unnecessary to turn the page, and the manual operations to beperformed in the reading are simplified. The voices of reciter imagescan be specified by selecting the reciter images to be allocated to thecharacters appearing in the book and can also be heard. The usertherefore can enjoy reading comfortably.

[0172] The present invention is not limited to the contents of the aboveembodiment and is modifiable without departing from the spirit and scopeof the present invention. For example, a voice recognizer 2A may beprovided that performs an analysis process including shortening a voicespectrum of a voice signal input by the voice input unit 14, causing apattern of the voice signal to match with a reference pattern torecognize the voice, and then outputting a result of the voicerecognition. For example, it may be arranged that when a callee'stelephone terminal No. is to be dialed, his or her telephone number dataand name stored in corresponding relationship in the internal RAM 7 areinstead inputted in voice into the microphone 1C, and that the voicerecognizer 2A specifies the callee in its voice recognition process andalso specifies in voice the book data to be read aloud.

[0173] While in the embodiment book data is illustrated as being readaloud, for example, an electronic mail received externally via thecommunication I/F 9 may be read aloud in the voice of the reciter imagedelivered by the server 30.

[0174] In this case, if the CPU 2 receives the electronic mail (letterdata) via the communication I/F 9, stores it in the mail data storagearea 7 e of the internal RAM 7, and causes a reciter image to read aloudthe electronic mail, stored in the mail data storage area 7 e bymanipulating the input unit 3, in the reciter's voice represented by thevoice data delivered by the server 30, the user can listen to theelectronic book device 1 read the externally received electronic mailaloud.

[0175] In this case, the server 30 may prestore in the character imageROM 32B a plurality of different action images of each of the reciterimages N21-N25 corresponding to letter data (words, a speech or asentence of greeting) of a respective one of a plurality of electronicmails. The book device 1 can receive and store the plurality ofdifferent action images of each of the reciter images N21-N25 from theserver 30. The book device 1 can then read and display sequentially onthe display unit 4 the plurality of different actions of the reciterimage in accordance with the letter data (text of the electronic mailstored in the mail data storage area 7 e being read aloud in the voiceof the reciter. For example, when the letter data of the electronic mailincludes a sentence of greeting “Good morning”, the reciter image N21can be displayed so as to gesture “Good morning” while saying so.

[0176] A touch panel may be provided on each of the two display panels1A and 1B of electronic book device 1 such that when one of the touchpanels is depressed at any particular position, detailed data related tothe depressed position is displayed on the other touch panel. Forexample, contents representing chapters of a book maybe provided so asto be displayed on one of the display panels. When a desired title ofthe contents is pressed, book data of a chapter indicated by the titlemay be displayed on the other display panel. In this case, turning thepage in the electronic book device 1 is simplified to thereby enjoy morecomfortable reading.

[0177] The wearable device 20 may include a headphone type book datareproducer with ear pads that include a receiving section which receivesa memory card (external memory), and a voice producing unit 13 and avoice output unit 15 that cooperate to reproduce a voice that reads bookdata aloud. A plurality of desired book data can be downloaded from thehost server 30 of the book data delivery center HS via the communicationI/F 9 and stored on the memory card. Book data selected by the user canbe read aloud in a voice corresponding to the selected voice data.

[0178] Also, when there arrives a telephone call during reading aloud ofthe book data in such headphone type book data reproducer, the CPU 2generates a telephone-call arrival reporting command and a reproductionstop command to thereby cause the reproducer 20 to report the arrival ofthe telephone call, and to stop reading the book data aloud and displayof the book data on the display unit 4 of the book device 50. At thistime, the CPU 2 stores the position where the reproduction stopped inthe incoming-call register 7 i of the internal RAM 7. When the telephonecall end, reading aloud the book data reopens at the position where thereading aloud of the book data stopped.

[0179] Thus, even the headphone type book data reproducer can downloaddesired book data externally and store it on the memory card. The usercan enjoy listening to the book being read aloud. When there is anarrival of a telephone call during reproduction of the book data, thetelephone call is reported and reading the book aloud is automaticallystopped. Thus, the user can rapidly respond to the telephone call. Theposition on a page where reading of the book data was stopped is storedwhen there is a telephone call and reproduction of the book dataautomatically reopens at that position when the telephone call ends.Thus, no manual operations are required when the reading reopens.

[0180] Provision of the timepiece 12 on the headphone type book datareproducer 60 and/or provision of the voice input unit 14 and rotaryswitch 11 on the electronic book device 50 are possible withoutdeparting from the scope of the present invention.

[0181] According to this embodiment, when delivery of book data and theimages of reciters who are, for example, favorite famous persons, voiceactors/actresses, animation characters, etc., is requested via thecommunication means by an external electronic book device, the hostserver can read out the book data, reciter images and correspondingvoice data satisfying the request from among the plurality of such datastored in the storage means and send the data via the communicationmeans to the external electronic book device. Thus, this process can beperformed rapidly and easily. Thus, the user can anywhere acquirereciter images that read book data aloud and corresponding voice data,and reproduce the book data in the voices of the reciter images. Thevoices of the reciter images may additionally include those of animationcharacters.

[0182] According to this embodiment, when an external terminal (forexample, a copyright holder terminal that has stored work data such asreciter images that read the content of an electronic book aloud, andcorresponding voice data) sends those data via the network to the hostserver, the host server stores the received reciter images and voicedata in corresponding relationship. When the host server is requested todeliver reciter images via the network from an external electronic bookdevice, the host server reads out the requested reciter images andcorresponding voice data and then sends those data to the external bookdevice. Thus, the host server can rapidly and securely perform thisprocess.

[0183] According to this embodiment, in the electronic book deviceconnected via a network to the external book device delivery source theelectronic book device can receive via the network from the externalbook device delivery source a plurality of book titles and a pluralityof reciter images that read aloud the respective contents of bookshaving those titles, and select a desired book title from among thereceived plurality of book titles and desired ones from the plurality ofreciter images. The book device can further receive from the book datadelivery source the book data specified by the desired book title, thespecified reciter images and the corresponding voice data, and displaysthose data. The electronic book device can reproduce the contents of thebook represented by the displayed book data in the voices of thedisplayed reciter images represented by the voice data. The reciterimages include the images of famous persons, voice actors/actresses,etc. Thus, while the user is watching the delivered book data and thedesired character images, the user can listen to the desired reciterimages reading aloud the delivered book data in their peculiarcomfortable voices.

What is claimed is:
 1. An electronic book data delivery apparatuscomprising: storage means having stored a plurality of book data eachrepresenting the content of an electronic book, a plurality of reciterimages each for reading aloud the content of a book represented by arespective one of the plurality of book data, and a plurality of voicedata each representing a voice of a respective one of the plurality ofreciter images; receiving means for receiving a request for delivery ofa selected one of the plurality of book data and at least one selectedone of the plurality of reciter images for reading aloud the selectedbook data from an external electronic book device via communicatingmeans; and sending means, responsive to the request for delivery, forreading the selected book data, the at least one reciter image, andvoice data representing the voice of the at least one reciter image fromsaid storage means and for sending those data via the communicationmeans to said external electronic book device.
 2. The electronic bookdata delivery apparatus according to claim 1, wherein: the book datacomprises a plurality of character images appearing in the electronicbook and said sending means comprises image sending means for sendingsaid external electronic book device selected ones of the plurality ofreciter images and the selected plurality of character images.
 3. Theelectronic book data delivery apparatus according to claim 1, wherein:said storage means comprises substorage means in which the plurality ofreciter images and the plurality of character images appearing in theelectronic book are stored in corresponding relationship; and saidsending means comprises image sending means for sending the plurality ofreciter images and the plurality of character images stored in saidsubstorage means to the external electronic book device.
 4. Theelectronic book data delivery apparatus according to claim 3, wherein:said character image sending means comprises voice data sending meansfor sending the plurality of voice data each representing the voice of arespective one of the plurality of reciter images stored in said storagemeans to the external electronic book device when the plurality ofreciter images are sent to the external electronic book device.
 5. Anelectronic book data delivery apparatus comprising: first receivingmeans for receiving at least one reciter image and corresponding voicedata used to read the contents of an electronic book aloud, via anetwork from an external terminal; storage means for storing the atleast one reciter image and corresponding voice data in correspondingrelationship; second receiving means for receiving a request fordelivery of at least one reciter image via a network from an externalelectronic book device; and sending means, responsive to said secondreceiving means receiving the request for delivery, for reading out theat least one reciter image and corresponding voice data that satisfy therequest from said storage means, and for sending the read at least oneimage and corresponding voice data to the external electronic bookdevice.
 6. The electronic book data delivery apparatus according toclaim 5, further comprising: price data receiving means, responsive tosaid electronic book data delivery apparatus receiving the at least onereciter image and corresponding voice data from the external terminalvia the network and/or responsive to said electronic book data deliveryapparatus sending the at least one reciter image and corresponding voicedata to the external electronic book device at its request, forreceiving data on the price and/or a charge for delivery of the at leastone reciter image and corresponding voice data.
 7. The electronic bookdata delivery apparatus according to claim 5, further comprising:publishing means for publishing on the network the plurality of reciterimages stored in said storage means; and said sending means comprisesmeans for reading at least one reciter image and corresponding voicedata from said storage means at a request of the external electronicbook device and for sending the read at least one image andcorresponding voice data to the external electronic book device.
 8. Theelectronic book data delivery apparatus according to claim 7, wherein:said publishing means comprises means, responsive to said electronicbook data delivery apparatus receiving at least one reciter image viathe network from the external terminal, for publishing the received atleast one reciter image on the network.
 9. An electronic book deviceconnected via a network to an external book data delivery source havingstored a plurality of book titles, a plurality of reciter images and aplurality of voice data each representing a voice of a respective one ofthe plurality of reciter images, comprising: first receiving means forreceiving via the network a plurality of book titles and a plurality ofreciter images each used to read aloud the contents of a book having arespective one of the plurality of book titles; specifying means forspecifying a desired one from among the plurality of book titlesreceived by said first receiving means and at least one desired reciterimage from among the plurality of reciter images for causing thespecified at least one desired image to read aloud the contents of thebook having the specified title; second receiving means for receivingbook data having the specified book title, the specified at least onereciter image, and the corresponding voice data from the external bookdata delivery source; display means for displaying the book data and theat least one reciter image received by said second receiving means; andreproducing means for reproducing the content of the book that isrepresented by the book data displayed by said display means in avoice(s) represented by the voice data corresponding to the displayed atleast one reciter image.
 10. The electronic book device according toclaim 9, wherein: said book data comprises a plurality of characterimages each representing a character appearing in the electronic book.11. A recording medium that comprises a computer readable program whichcauses a computer to operate as an electronic book data deliveryapparatus comprising: storage means having stored a plurality of bookdata each representing the content of an electronic book, a plurality ofreciter images each for reading aloud the content of a book representedby a respective one of the plurality of book data, and a plurality ofvoice data each representing a voice of a respective one of theplurality of reciter images; receiving means for receiving a request fordelivery of a selected one of the plurality of book data and at leastone selected one of the plurality of reciter images for reading aloudthe selected book data from an external electronic book device viacommunicating means; and sending means, responsive to the request fordelivery, for reading the selected book data, the at least one reciterimage, and voice data representing the voice of the at least one reciterimage from said storage means and for sending those data via thecommunication means to said external electronic book device.
 12. Therecording medium according to claim 11, wherein: the book data comprisesa plurality of character images appearing in the electronic book; andsaid sending means comprises image sending means for sending saidexternal electronic book device selected ones of the plurality ofreciter images and the selected plurality of character images.
 13. Therecording medium according to claim according to claim 11, wherein: saidstorage means comprises substorage means in which the plurality ofreciter images and the plurality of character images appearing in theelectronic book are stored in corresponding relationship; and saidsending means comprises image sending means for sending the plurality ofreciter images and the plurality of character images stored in saidsubstorage means to the external electronic book device.
 14. Theelectronic book data delivery apparatus according to claim 13, wherein:said character image sending means comprises voice data sending meansfor sending the plurality of voice data each representing the voice of arespective one of the plurality of reciter images stored in said storagemeans to the external electronic book device when the plurality ofreciter images are sent to the external electronic book device.
 15. Arecording medium that comprises a computer readable program which causesa computer to operate as an electronic book data delivery apparatuscomprising: first receiving means for receiving at least one reciterimage and corresponding voice data used to read the contents of anelectronic book aloud, via a network from an external terminal; storagemeans for storing the at least one reciter image and corresponding voicedata in corresponding relationship; second receiving means for receivinga request for delivery of at least one reciter image via a network froman external electronic book device; and sending means, responsive tosaid second receiving means receiving the request for delivery, forreading out the at least one reciter image and corresponding voice datathat satisfy the request from said storage means, and for sending theread at least one image and corresponding voice data to the externalelectronic book device.
 16. The recording medium according to claim 15,wherein the electronic book data delivery apparatus further comprises:means, responsive to said electronic book data delivery apparatusreceiving the at least one reciter image and corresponding voice datafrom the external terminal via the network and/or responsive to saidelectronic book data delivery apparatus sending the at least one reciterimage and corresponding voice data to the external electronic bookdevice at its request, for receiving data on the price and/or a chargefor delivery of the at least one reciter image and corresponding voicedata.
 17. The recording medium according to claim 15, wherein theelectronic book data delivery apparatus according to claim 5, furthercomprising: means for publishing on the network the plurality of reciterimages stored in said storage means; and said sending means comprisesmeans for reading at least one reciter image and corresponding voicedata from said storage means at a request of the external electronicbook device and for sending the read at least one image andcorresponding voice data to the external electronic book device.
 18. Therecording medium according to claim 15, wherein the electronic book datadelivery apparatus according to claim 5, wherein: said publishing meanscomprises means, responsive to said electronic book data deliveryapparatus receiving at least one reciter image via the network from theexternal terminal, for publishing the received at least one reciterimage on the network.
 19. A recording medium that comprises a computerreadable program which causes a computer to operates as an electric bookdevice connected via a network to an external book data delivery sourcehaving stored a plurality of book titles, a plurality of reciter imagesand a plurality of voice data each representing a voice of a respectiveone of the plurality of reciter images, comprising: first receivingmeans for receiving via the network a plurality of book titles and aplurality of reciter images each used to read aloud the contents of abook having a respective one of the plurality of book titles; specifyingmeans for specifying a desired one from among the plurality of booktitles received by said first receiving means and at least one desiredreciter image from among the plurality of reciter images for causing thespecified at least one desired image to read aloud the contents of thebook having the specified title; second receiving means for receivingbook data having the specified book title, the specified at least onereciter image, and the corresponding voice data from the external bookdata delivery source; display means for displaying the book data and theat least one reciter image received by said second receiving means; andmeans for reproducing the content of the book that is represented by thebook data displayed by said display means in a voice(s) represented bythe voice data corresponding to the displayed at least one reciterimage.
 20. A computer readable program which causes a computer tooperate as an electronic book data delivery apparatus comprising: firstreceiving means for receiving at least one reciter image andcorresponding voice data used to read the contents of an electronic bookaloud, via a network from an external terminal; storage means forstoring the at least one reciter image and corresponding voice data incorresponding relationship; second receiving means for receiving arequest for delivery of at least one reciter image via a network from anexternal electronic book device; and sending means, responsive to saidsecond receiving means receiving the request for delivery, for readingout the at least one reciter image and corresponding voice data thatsatisfy the request from said storage means, and for sending the read atleast one image and corresponding voice data to the external electronicbook device.